Method of transmitting a medical image, and a medical imaging apparatus performing the method

ABSTRACT

A medical image transmitting method includes obtaining a medical image generated by imaging an object; performing a first determination to determine whether the object has an abnormality, based on the medical image; performing a second determination to determine, based on the first determination, whether to transmit at least one assistance image associated with the medical image; and when the object has no abnormalities, transmitting, to an external apparatus, the medical image, thereby minimizing a data processing amount and a data transmission amount.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 U.S.C. § 119to Korean Patent Application No. 10-2017-0142565, filed on Oct. 30,2017, and Korean Patent Application No. 10-2018-0129779 filed on Oct.29, 2018, in the Korean Intellectual Property Office, the disclosures ofwhich are incorporated by reference herein in their entirety.

BACKGROUND 1. Field

The disclosure relates to a method and apparatus for transmitting atleast one of a medical image and a read assistance image associated withthe medical image to an external apparatus.

More particularly, the disclosure relates to a method and apparatus forobtaining a medical image, generating at least one read assistance imageassociated with the obtained medical image, based on the obtainedmedical image, and transmitting at least one of the medical image andthe at least one read assistance image to an external apparatus.

2. Description of the Related Art

Medical imaging apparatuses are used for capturing images of an internalstructure of an object such as a patient, or a part of a patient, suchas an internal organ. Medical imaging apparatuses are noninvasiveexamination apparatuses that capture and process images of thestructural details of a human body, such as internal tissues thereof, orfluid flow within a human body, and provide the processed images to auser. A user, such as a doctor or another type of healthcare provider,may diagnose a health state and a disease of a patient by using amedical image output from a medical imaging apparatus.

Examples of medical imaging apparatuses include X-ray apparatuses forobtaining an image by radiating an X-ray to an object and sensing anX-ray transmitted by the object, magnetic resonance imaging (MRI)apparatuses for providing a magnetic resonance (MR) image, computedtomography (CT) apparatuses, and ultrasound diagnostic apparatuses.

SUMMARY

Provided are a medical image transmitting method capable of minimizingan increase in a memory capacity, an increase in a data processingamount, and an increase in a data transmission amount that occur when amedical image and at least one read assistance image are transmitted toan external apparatus, and a medical imaging apparatus performing themedical image transmitting method.

In detail, provided are a medical image transmitting method capable ofminimizing an increase in a memory capacity, an increase in a dataprocessing amount, and an increase in a data transmission amount thatoccur when an X-ray image and at least one read assistance imageproduced based on the X-ray image are transmitted to an externalapparatus, and a medical imaging apparatus performing the medical imagetransmitting method.

Provided are a medical image transmitting method enabling a doctor tomore conveniently determine whether an abnormality has been generated inan object, by using a medical image, and a medical imaging apparatusperforming the medical image transmitting method.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented embodiments.

In accordance with an aspect of the disclosure, a medical imagetransmitting method includes obtaining a medical image generated byimaging an object; performing a first determination to determine whetherthe object has an abnormality, based on the medical image, andperforming a second determination to determine, based on the firstdetermination, whether to transmit at least one assistance imageassociated with the medical image; and, when the object has noabnormalities, transmitting, to an external apparatus, the medical imageand not the at least one assistance image.

The transmitting, to the external apparatus, of the medical image andnot the at least one assistance image may include, when the object hasno abnormalities, not generating the at least one assistance imageassociated with the medical image and transmitting the medical image tothe external apparatus.

The medical image transmitting method according to an embodiment mayfurther include, when the object has an abnormality, generating at leastone read assistance image associated with the medical image andtransmitting the medical image and the at least one read assistanceimage to the external apparatus.

The medical image transmitting method may further include, when theobject has an abnormality, generating the at least two assistance imagesassociated with the medical image; and arranging the at least twoassistance images in a certain order, based on characteristics of anabnormal part of the object, and transmitting the medical image and theat least two assistance images arranged in the certain order to theexternal apparatus.

The transmitting of the medical image and not the at least oneassistance image to the external apparatus may include, when the objecthas no abnormalities, attaching, to the medical image, a normality markindicating that the object is normal, and transmitting, to the externalapparatus, the medical image to which the normality mark has beenattached.

The transmitting, to the external apparatus, of the medical image andnot the at least one read assistance image may further include, when theobject has an abnormality, attaching, to the medical image, anabnormality mark indicating that the object is abnormal, andtransmitting, to the external apparatus, the medical image to which theabnormality mark has been attached.

The medical image transmitting method may further include, when theobject has a lesion, determining a type of a assistance image to begenerated, based on characteristics of the lesion, and generating the atleast one assistance image according to the determined type; andtransmitting the medical image and the at least one assistance image tothe external apparatus.

The medical image transmitting method may further include, when theobject has no abnormalities, generating data corresponding to a firstuser interface (UI) screen including the medical image and not the atleast one assistance image; and when the object has an abnormality,generating data corresponding to a second UI screen including themedical image and the at least one assistance image.

The medical image transmitting method according to an embodiment mayfurther include displaying the first UI screen or the second UI screenon a display.

The medical image transmitting method may further include, when theobject has no abnormalities, transmitting the data corresponding to thefirst UI screen to the external apparatus; and when the object has anabnormality, transmitting the data corresponding to the second UI screento the external apparatus.

The first determination may include determining whether the object hasan abnormality, via learning operations based on a deep neural network(DNN).

The medical image may include an X-ray image, and the external apparatusmay include at least one of a picture archiving communications system(PACS) server, a PACS viewer, and a workstation for controlling amedical imaging apparatus that performs medical image capturing.

In accordance with another aspect of the disclosure, a medical imagingapparatus includes a controller configured to obtain a medical imagegenerated by imaging an object, performing a first determination todetermine whether the object has an abnormality, performing a seconddetermination to determine, based on the first determination, whether totransmit at least one assistance image associated with the medicalimage, and, when the object has no abnormalities, transmit, to anexternal apparatus, the medical image and not the assistance image; anda communicator configured to transmit the medical image to the externalapparatus under the control of the controller.

When the object has no abnormalities, the controller may be furtherconfigured to attach, to the medical image, a normality mark indicatingthat the object is normal, and transmit, to the external apparatus, themedical image to which the normality mark has been attached.

When the object has an abnormality, the controller may be furtherconfigured to attach, to the medical image, an abnormality markindicating that the object is abnormal, and transmit, to the externalapparatus, the medical image to which the abnormality mark has beenattached.

When the object has an abnormality, the controller may be furtherconfigured to generate the at least two assistance images associatedwith the medical image, arrange the at least two assistance images in acertain order, based on characteristics of an abnormal part of theobject, and control the medical image and the at least two assistanceimages arranged in the certain order to be transmitted to the externalapparatus.

When the object has a lesion, the controller may be further configuredto determine a type of a assistance image that is to be generated, basedon a type of the lesion, generate the at least one assistance imageaccording to the determined type, and transmit the medical image and theat least one assistance image to the external apparatus.

When the object has no abnormalities, the controller may be furtherconfigured to control generation of data corresponding to a first UIscreen including the medical image and not the at least one assistanceimage. When the object has an abnormality, the controller may be furtherconfigured to control generation of data corresponding to a second UIscreen including the medical image and the at least one assistanceimage. The controller may be further configured to control transmittingof the data corresponding to the first UI screen or the datacorresponding to the second UI screen to the external apparatus.

When the object has no abnormalities, the controller may be furtherconfigured to control generation of data corresponding to a first UIscreen including the medical image and not the at least one assistanceimage. When the object has an abnormality, the controller may be furtherconfigured to control generation of data corresponding to a second UIscreen including the medical image and the at least one assistanceimage. The medical imaging apparatus may further include a displayconfigured to display the first UI screen or the second UI screen underthe control of the controller.

The medical imaging apparatus may further include a deep neural network(DNN) processor configured to perform learning operations via a DNN. Thecontroller may be further configured to determine whether the object hasan abnormality, via the learning operations based on the DNN.

The medical imaging apparatus may further include an X-ray radiatorconfigured to radiate an X-ray to the object. The controller may befurther configured to control the X-ray radiator to obtain the medicalimage.

The at least one assistance image may be generated based on an analysisof the medical image, and the at least one assistance image may includea lesion and a marking indicating a presence of the lesion.

In accordance with another aspect of the disclosure, a medical imagingapparatus includes a communicator; and a controller configured to obtaina medical image generated by imaging an object, analyze the medicalimage to determine whether an abnormality is present or the abnormalityis not present in the medical image, if the abnormality is present inthe medical image, generate at least one assistance image based on themedical image in an assistance image generation operation, and controlthe communicator to transmit both the medical image and the at least oneassistance image to an external apparatus, and if the abnormality is notpresent in the medical image, not generate the at least one assistanceimage by skipping the assistance image generation operation and controlthe communicator to transmit only the medical image, to the externalapparatus, wherein the at least one assistance image comprises a markingindicating a presence of the abnormality.

The controller may obtain the medical image by receiving the medicalimage from an external apparatus.

The medical imaging apparatus may include an X-ray generator and anX-ray detector, and the controller images the object and obtains themedical image by activating the X-ray generator and detecting signalsgenerated by the X-ray detector.

The controller may generate a plurality of assistance images if anabnormality is present, and each assistance image is based on themedical image.

In accordance with another aspect of the disclosure, a medical imagingapparatus includes a display; and a controller configured to obtain amedical image generated by imaging an object, analyze the medical imageto determine whether an abnormality is present in the medical image, ifan abnormality is present in the medical image, generate at least oneassistance image and control the display to display both the medicalimage and the at least one assistance image, and if an abnormality isnot present in the medical image, control the display to display onlythe medical image, and not the at least one assistance image.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is an external view and block diagram of a configuration of anX-ray apparatus according to an embodiment;

FIG. 2 is a block diagram of a medical imaging apparatus according to anembodiment;

FIG. 3 is a block diagram of a medical imaging apparatus according toanother embodiment;

FIG. 4 is a flowchart of a medical image transmitting method accordingto an embodiment;

FIG. 5A is a flowchart of a medical image transmitting method accordingto another embodiment;

FIG. 5B is a flowchart of a medical image transmitting method accordingto another embodiment;

FIG. 5C is a flowchart of a medical image transmitting method accordingto another embodiment;

FIG. 6 illustrates a medical image obtained by an apparatus and amethod, according to an embodiment;

FIG. 7 is a view for explaining a deep neural network (DNN) that is usedin an apparatus and a method, according to an embodiment;

FIG. 8A is a view illustrating a medical image corresponding to when anobject has an abnormality;

FIGS. 8B through 8D are views illustrating read assistance imagesgenerated when an object has an abnormality;

FIG. 9 is a view illustrating a user interface (UI) screen generated inan apparatus and a method, according to an embodiment;

FIG. 10 is another view illustrating a UI screen generated in anapparatus and a method, according to an embodiment;

FIG. 11 is another view illustrating a UI screen generated in anapparatus and a method, according to an embodiment;

FIGS. 12A and 12B are other views illustrating UI screens generated inan apparatus and a method, according to an embodiment;

FIG. 13 is a block diagram illustrating an implementation of a medicalimaging apparatus according to an embodiment;

FIG. 14 is a block diagram illustrating another implementation of amedical imaging apparatus according to an embodiment; and

FIG. 15 is a block diagram illustrating another implementation of amedical imaging apparatus according to an embodiment.

DETAILED DESCRIPTION

Certain exemplary embodiments are described in greater detail below withreference to the accompanying drawings.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of exemplaryembodiments. Thus, it is apparent that exemplary embodiments can becarried out without those specifically defined matters. Also, well-knownfunctions or constructions are not described in detail since they wouldobscure exemplary embodiments with unnecessary detail.

Terms such as “part” and “portion” used herein denote those that may beembodied by software or hardware. According to exemplary embodiments, aplurality of parts or portions may be embodied by a single unit orelement, or a single part or portion may include a plurality ofelements.

In the present specification, an image may include a medical imageobtained by a magnetic resonance imaging (MRI) apparatus, a computedtomography (CT) apparatus, an ultrasound imaging apparatus, an X-rayapparatus, or another medical imaging apparatus.

Furthermore, in the present specification, an “object” may be a targetto be imaged and may include a human, an animal, or a part of a human oranimal. For example, the object may include a body part (an organ,tissue, etc.) or a phantom.

FIG. 1 is an external view and block diagram of a configuration of anX-ray apparatus 100 according to an embodiment.

In FIG. 1, it is assumed that the X-ray apparatus 100 is a fixed X-rayapparatus.

Referring to FIG. 1, the X-ray apparatus 100 includes an X-ray radiationdevice for generating and emitting X-rays, an X-ray detector 195 fordetecting X-rays that are emitted by the X-ray radiation device 110 andtransmitted through an object P, and a workstation 180 for receiving acommand from a user and providing information to the user.

The X-ray apparatus 100 may further include a controller 120 forcontrolling the X-ray apparatus 100 according to the received command,and a communicator 140 for communicating with an external device.

All or some components of the controller 120 and the communicator 140may be included in the workstation 180 or be separate from theworkstation 180.

The X-ray radiation device 110 may include an X-ray source forgenerating X-rays and a collimator for adjusting a region irradiatedwith the X-rays generated by the X-ray source.

A guide rail 30 may be provided on a ceiling of an examination room inwhich the X-ray apparatus 100 is located, and the X-ray radiation device110 may be coupled to a moving carriage 40 that is movable along theguide rail 30 such that the X-ray radiation device 110 may be moved to aposition corresponding to the object P. The moving carriage 40 and theX-ray radiation device 110 may be connected to each other via a foldablepost frame 50 such that a height of the X-ray radiation device 110 maybe adjusted.

The workstation 180 may include an input device 181 for receiving a usercommand and a display 182 for displaying information.

The input device 181 may receive commands for controlling imagingprotocols, imaging conditions, imaging timing, and locations of theX-ray radiation device 110.

The input device 181 may include a keyboard, a mouse, a touch screen, amicrophone, a voice recognizer, etc., or a combination of at least twoof these components.

The display 182 may be an LCD or OLED display, and may display a screenfor guiding a user's input, an X-ray image, a screen for displaying astate of the X-ray apparatus 100, and the like.

The controller 120 may control imaging conditions and imaging timing ofthe X-ray radiation device 110 according to a command input by the userand may generate a medical image based on image data received from anX-ray detector 195.

Furthermore, the controller 120 may control a position or orientation ofthe X-ray radiation device 110 or mounting units 14 and 24, each havingthe X-ray detector 195 mounted therein, according to imaging protocolsand a position of the object P. That is, the mounting units 14 and 24are both able to receive and hold the X-ray detector 195.

The controller 120 may include a memory configured to store programs forperforming the operations of the X-ray apparatus 100 and a processor ora microprocessor configured to execute the stored programs. The memorymay be RAM or ROM. The memory may be a non-transitory storage mediumthat stores software programs.

The controller 120 may include a single processor or a plurality ofprocessors or microprocessors. When the controller 120 includes theplurality of processors, the plurality of processors may be integratedonto a single chip or be physically separated from one another.

The X-ray apparatus 100 may be connected to external devices such as anexternal server 151, a medical apparatus 152, and/or a portable terminal153 (e.g., a smart phone, a tablet PC, or a wearable electronic device)in order to transmit or receive data via the communicator 140.

The communicator 140 may include at least one component that enablescommunication with an external device. For example, the communicator 140may include at least one of a local area communication module, a wiredcommunication module, and a wireless communication module. Thecommunicator may include communication circuitry such as Wi-Ficircuitry, Bluetooth circuitry, or millimeter wave band circuitry.

The communicator 140 may receive a control signal from an externaldevice and transmit the received control signal to the controller 120 sothat the controller 120 may control the X-ray apparatus 100 according tothe received control signal.

In addition, by transmitting a control signal to an external device viathe communicator 140, the controller 120 may control the external deviceaccording to the control signal.

For example, the external device may process data of the external deviceaccording to the control signal received from the controller 120 via thecommunicator 140.

The communicator 140 may further include an internal communicationmodule that enables communications between components of the X-rayapparatus 100.

A program for controlling the X-ray apparatus 100 may be installed onthe external device and may include instructions for performing some orall of the operations of the controller 120.

The program may be preinstalled on the portable terminal 153, or a userof the portable terminal 153 may download the program from a serverproviding an application for installation.

The server that provides applications may include a recording mediumwhere the program is stored.

Furthermore, the X-ray detector 195 may be implemented as a fixed X-raydetector that is fixedly mounted to a stand 20 or a table 10 or as aportable X-ray detector that may be detachably mounted in the mountingunit 14 or 24 or can be used at arbitrary positions.

The portable X-ray detector may be implemented as a wired or wirelessdetector according to a data transmission technique and a power supplymethod.

The X-ray detector 195 may or may not be a component of the X-rayapparatus 100.

If the X-ray detector 195 is not a component of the X-ray apparatus 100,the X-ray detector 195 may be registered by the user to operate with theX-ray apparatus 100.

Furthermore, in both cases, the X-ray detector 195 may be connected tothe controller 120 via the communicator 140 to receive a control signalfrom or transmit image data to the controller 120.

A sub-user interface 80 that provides information to a user and receivesa command from the user may be provided on one side of the X-rayradiation device 110. The sub-user interface 80 may also perform some orall of the functions performed by the input device 181 and the display182 of the workstation 180. That is, the sub-user interface may includea separate display and a separate input device.

When all or some components of the controller 120 and the communicator140 are separate from the workstation 180, they may be included in thesub-user interface 80 provided on the X-ray radiation device 110.

Although FIG. 1 shows a fixed X-ray apparatus connected to the ceilingof the examination room, examples of the X-ray apparatus 100 may includeother configurations such as a C-arm type X-ray apparatus, a mobileX-ray apparatus, and other X-ray apparatuses having various structures.

With recent developments in image processing technology, such as acomputer aided detection (CAD) system and machine learning, medicalimaging apparatuses may analyze an obtained medical image by using acomputer, and thus detect an abnormal region, which is an abnormal partof an object, and generate a result of the analysis. An image generatedagain by analyzing the obtained medical image as described above isreferred to as an ‘assistance image’ or ‘read assistance image’. Whenthe assistance image is provided to a doctor, the doctor may more easilydiagnose whether an abnormality is present in an object, by referring tothe assistance image.

Medical imaging apparatuses may transmit a medical image and at leastone assistance image to an external apparatus. Accordingly, the externalapparatus may also diagnose a patient by using the medical image and theassistance image.

However, when a medical image and at least one assistance image areprovided to an external apparatus, a memory capacity, a data processingamount, and a data transmission amount, which are required, relativelyincrease, compared to when the medical image is transmitted to theexternal apparatus. Hereinafter, an image generated again by analyzingthe obtained medical image will be referred to as a read assistanceimage.

To improve the ease of reading of a medical image or a diagnosis using amedical image, a medical imaging apparatus or an external apparatus (forexample, an external apparatus 150) that receives a medical image fromthe medical imaging apparatus may generate a read assistance image byusing the medical image and may provide the generated read assistanceimage to a user.

In detail, the medical imaging apparatus may analyze an obtained medicalimage by using a computer, according to image processing technology,such as a computer aided detection (CAD) system or machine learning. Themedical imaging apparatus may detect an abnormal region, which is anabnormal part of an object, or may generate a result of the analysis.

In general, the medical imaging apparatus that generates a readassistance image and provides the generated read assistance image to auser may be the controller 120 of the X-ray apparatus 100 of FIG. 1, theworkstation 180 of the X-ray apparatus 100, a picture archivingcommunications system (PACS) server, a PACS viewer, or the like. Themedical imaging apparatus may also be any electronic device capable ofobtaining a medical image and generating a read assistance image basedon the obtained medical image.

Medical imaging apparatuses obtain medical images, analyze each of theobtained medical images, and generate one or more read assistance imagesassociated with each of the obtained medical images. The medical imagingapparatuses may transmit the obtained medical images and the readassistance images to an external apparatus such that the externalapparatus may use the received medical images and the received readassistance images.

For example, when the medical imaging apparatus is the X-ray apparatus100 of FIG. 1, a space where a doctor diagnoses whether an object has anabnormality by using a medical image and read assistance images isusually separated from a space where the X-ray apparatus 100 is mounted.For example, the X-ray apparatus 100 may be located in a radiation room,and reading by a doctor may be performed in a doctor's office separatefrom the radiation room. In this case, the X-ray apparatus 100 needs totransmit an obtained medical image and an obtained read assistance imageto an external apparatus, for example, a PACS viewer or a doctor'scomputer provided in the doctor's office. Then, the doctor may view themedical image and the read assistance image via the PACS viewer and maydiagnose the object or patient.

As another example, when the medical imaging apparatus is the X-rayapparatus 100 of FIG. 1, a medical image and read assistance imagesobtained by the X-ray apparatus 100 need to be stored in a server, forexample, a PACS server, or an electronic device, in order to storemedical recordings of a patient. In this case, the X-ray apparatus 100needs to transmit the obtained medical image and the obtained readassistance images to the server or the electronic device physicallydistinguished from the X-ray apparatus 100.

However, when an object has no abnormalities, a doctor, for example, mayeasily determine that the object has no abnormalities, by only using theobtained medical image. In other words, without using the readassistance image, a user, such as a doctor, may easily ascertain thatthe object has no abnormalities, by only using the original medicalimage. Accordingly, when an object has no abnormalities, it is notnecessary to generate a read assistance image and transmit and/or storethe generated read assistance image to and/or in an external apparatus,for example, a PACS viewer.

To generate a read assistance image and transmit the generated readassistance image to the external apparatus, a data processing amount, amemory capacity, and a read assistance image acquisition time periodthat are required for image processing all increase, and a required datatransmission amount also increases. This time increase that occurs as aresult of a need to generate and transmit a read assistance image maydegrade a workflow of medical image reading and may degrade readingefficiency.

In a medical imaging apparatus according to an embodiment and a medicalimage transmitting method performed thereby, a medical image may beprimarily analyzed to determine whether an object has an abnormality,and it may be automatically determined, based on the primarydetermination, whether to transmit a read assistance image to anexternal apparatus. Accordingly, unnecessary generation and/ortransmission of the read assistance image may be prevented. That is, bydetermining whether or not to generate or transmit a read assistanceimage, the medical imaging apparatus can process medical image data moreefficiently because computational resources that would otherwise be usedfor an unnecessary process (i.e., generating a read assistance imagewhen there is no abnormality) can be preserved and used for other moreproductive computational objectives. This permits the medical imagingapparatus to process data more quickly, and/or at lower cost.Furthermore, memory requirements and data transmission requirements arereduced when this process is not performed. In short, computationalefficiency in several respects is enhanced. A medical imaging apparatusaccording to an embodiment capable of optimizing a workflow of medicalimage reading and increasing the reading efficiency of a doctor, and amedical image transmitting method performed thereby will now bedescribed in detail with reference to the accompanying drawings.

FIG. 2 is a block diagram of a medical imaging apparatus 200 accordingto an embodiment.

The medical imaging apparatus 200 according to an embodiment may includeany electronic device capable of obtaining a medical image and analyzingthe obtained medical image to generate a read assistance image.

In detail, a medical imaging apparatus may autonomously obtain a medicalimage via medical image capturing or may receive a medical imageobtained by another medical imaging apparatus.

For example, the medical imaging apparatus 200 according to anembodiment may be the X-ray apparatus 100 of FIG. 1. In this case, theX-ray apparatus 100 may autonomously obtain an X-ray image, which is amedical image, via X-ray scanning. In detail, the medical imagingapparatus according to an embodiment may be included in the controller120 or the workstation 180 of the X-ray apparatus 100 of FIG. 1.

As another example, the medical imaging apparatus 200 may be the server151, the medical apparatus 152, or the portable terminal 153 connectedto a medical imaging apparatus, such as the X-ray apparatus 100 of FIG.1, via a wired connection or a wireless communication network. In thiscase, the medical apparatus 152 may receive the X-ray image obtained bythe X-ray apparatus 100 as a medical image, and may analyze the receivedmedical image to generate a read assistance image.

A medical image obtained and used by a medical image transmitting methodaccording to an embodiment and a medical imaging apparatus performingthe medical image transmitting method may be any image that enables adetermination as to whether an object has an abnormality. In detail, themedical image may be an image of an object obtained by at least one ofthe X-ray apparatus 100 performing X-ray scanning, a CT system, an MRIsystem, an ultrasound diagnosis apparatus, and another medical imagingsystem.

The object may include a body part of a person, for example, a patient,who is a diagnosis target, and may include an organ (e.g., the liver,the heart, the womb, the brain, a breast, or the abdomen), or a bloodvessel, or plural blood vessels.

Throughout the specification, a “user” may be, but is not limitedthereto, a medical provider, such as a doctor, a nurse, a health caretechnician, or a medical imaging expert, or may be an engineer whomanages medical appliances.

A case where a medical image obtained and used by a medical imagetransmitting method according to an embodiment and a medical imagingapparatus performing the medical image transmitting method is an X-rayimage will now be illustrated and described.

A case where the medical imaging apparatus 200 according to anembodiment is the X-ray apparatus 100 of FIG. 1 will now be illustratedand described.

Referring to FIG. 2, the medical imaging apparatus 200 includes acontroller 210 and a communicator 220. When the medical imagingapparatus 200 corresponds to the X-ray apparatus 100 of FIG. 1, thecontroller 210 and the communicator 220 included in the medical imagingapparatus 200 may respectively correspond to either the controller 120or workstation 180 and the communicator 140 of the X-ray apparatus 100.Thus, a redundant description thereof will be omitted.

The controller 210 obtains a medical image obtained by imaging anobject. The controller 210 may first determine whether the object has anabnormality, by analyzing the received medical image, and secondlydetermine whether to transmit at least one read assistance imageassociated with the medical image, based on the first determination.When the object has no abnormalities, the controller 210 controls themedical image to be transmitted to an external apparatus 290. In detail,when the object has no abnormalities, the controller 210 controls themedical image, except for the read assistance image, to be transmittedto an external apparatus 290. In response to the medical image, thecontroller 210 may automatically perform the above-described twodeterminations. For convenience of explanation, the determination as towhether an object has an abnormality will now be referred to as a firstdetermination, and the determination as to whether to transmit at leastone read assistance image will now be referred to as a seconddetermination.

The controller 210 may include a memory (not shown), for example, ROM orRAM, and at least one processor (not shown) that performs instructionsfor performing the above-described operations. The at least oneprocessor included in the controller 210 may operate to execute theinstructions for performing the above-described operations. In detail,the at least one processor included in the controller 210 may operate toexecute a program including the instructions for performing theabove-described operations.

A case where an object has an abnormality may be referred to as a casewhere the object has any shape other than the shape of a healthy tissueor a case where the object is in a state other than a healthy state. Forexample, the case where the object has an abnormality may be a casewhere a certain part of the object has a disease.

A read assistance image is generated by processing a medical imageobtained via medical image capturing, and may be an image obtained byprocessing the medical image in order to facilitate reading of theobject. The read assistance image may include an image processed suchthat a disease may be easily detected.

In detail, the read assistance image may be an image on which anabnormal part is automatically detected and displayed, or an image onwhich the type of disease generated on the abnormal part, a result ofanalyzing a disease or a disease candidate, or probability informationabout what the generated disease is.

For example, when the original medical image is a chest X-ray image, theread assistance image may include a bone suppression image on which anorgan existing in the chest is more clearly shown by removing bonesexisting in the chest, a lesion-detected CAD image on which a lesionexisting in the object is detected via CAD and displayed, and anabnormality map on which an abnormal portion of a tissue or detailedareas included in the object is detected and displayed. The readassistance image may further include any image obtained by processingthe original medical image in order to help determine whether the objecthas an abnormality. In the above example, with regard to the bonesuppression image, when a lesion is located in a soft tissue included inthe object, for example, a lung, it is difficult to observe a lung parthidden by bones from the original medical image. However, when the bonesare removed from the chest X-ray image, the lung may be more clearlyobserved, and thus the lesion located in the lung may be easily read.

The read assistance image may be represented as data having no imageshapes. In detail, the read assistance image may include analysis dataindicating that the object has an abnormality.

For example, the read assistance image may include, as informationobtained based on the bone suppression image, information representing ageneration location of a disease, a revelation shape of the disease, therisk of the disease, the accuracy of detection of the disease, and areliability when an abnormality is determined as a disease, which isinformation indicating whether the object has an abnormality. Thedisease refers to all cases where the object has an abnormality, andthus may include a pneumothorax, a lesion, a tumor, a tissue change, andan abnormal organ shape generated within the object. The object havingan abnormality may include not only a case where the object has adisease, but also a case where a lesion is present in the object (forexample, deformation or the like of a cell, a tissue, an organ, or thelike before a tumor is generated). The read assistance image may includean image of the lesion and a marking indicating the presence of thelesion.

The controller 210 may perform the above-described operation ofdetermining whether an object has an abnormality and an abnormal portionanalyzing operation via machine learning, and this will be described indetail with reference to FIGS. 3 and 7.

The communicator 220 transmits the medical image to the externalapparatus 290 under the control of the controller 210.

The communicator 220 may include one or more components that enablecommunication with the external apparatus 290. For example, thecommunicator 220 may include a short distance communication module, awired communication module, and a wireless communication module.

In detail, the communicator 220 may be connected to a wired/wirelessnetwork 250 and thus may perform communication with the externalapparatus 290, for example, an external apparatus such as the server151, the medical apparatus 152, or the portable terminal 153 of FIG. 1.

The external apparatus 290 may be an electronic apparatus capable ofreceiving a medical image and at least one read assistance image andperforming at least one operation from among storing, processing,analyzing, and displaying the received images.

In detail, the external apparatus 290 may be a PACS (not shown), forexample, a PACS server or a PACS viewer. Accordingly, the medicalimaging apparatus 200 may exchange data with a hospital server oranother medical apparatus in a hospital, which is connected to themedical imaging apparatus 200 via a PACS (not shown) connected via thecommunicator 220.

In detail, when it is determined, based on the medical image, that theobject has no abnormalities, the controller 210 may control the medicalimage to be transmitted to the external apparatus 290, withoutgenerating a read assistance image associated with the medical image.

A detailed structure and a detailed operation of the medical imagingapparatus 200 will now be described in detail with reference to FIGS. 3through 8D.

FIG. 3 is a block diagram of a medical imaging apparatus 300 accordingto another embodiment. A controller 310 and a communicator 320 includedin the medical imaging apparatus 300 of FIG. 3 may respectivelycorrespond to the controller 210 and the communicator 220 of the medicalimaging apparatus 200 of FIG. 2. An external apparatus 390 of FIG. 3 maycorrespond to the external apparatus 290 of FIG. 2. Accordingly,descriptions of the medical imaging apparatus 300 that are the same asthose made with reference to FIG. 2 are not repeated herein.

Referring to FIG. 3, the medical imaging apparatus 300 may furtherinclude at least one of a deep neural network (DNN) processor 330, adisplay 340, a memory 350, and a user interface (UI) unit 360, comparedwith the medical imaging apparatus 200 of FIG. 2.

The controller 310 obtains a medical image obtained by imaging anobject. The controller 310 may determine whether the object has anabnormality, by analyzing the received medical image, and determinewhether to transmit at least one read assistance image associated withthe medical image, based on the determination.

The medical imaging apparatus 300 may obtain a medical image accordingto various methods. In detail, the medical imaging apparatus 300 mayinclude an image capturing apparatus (not shown), and the controller 310may drive the image capturing apparatus to obtain a medical image. Forexample, when the medical imaging apparatus 300 corresponds to the X-rayapparatus 100 of FIG. 1, the controller 310 may drive the X-rayradiation device 110 and the X-ray detector 195 to obtain an X-rayimage, which is the medical image.

The medical imaging apparatus 300 may receive the medical image from anexternal source. In detail, when the medical imaging apparatus 300 isimplemented as an apparatus independent from an electronic apparatusthat performs medical image capturing, for example, the X-ray apparatus100 of FIG. 1, the medical imaging apparatus 300 may receive the medicalimage from the electronic apparatus performing medical image capturing(hereinafter, referred to as an external medical imaging apparatus) viaa wired/wireless communication network. In this case, the medicalimaging apparatus 300 may receive the medical image from the externalmedical imaging apparatus via the communicator 320. In detail, themedical imaging apparatus 300 may receive an X-ray image, which is amedical image, from the X-ray apparatus 100 of FIG. 1 or the like viathe communicator 320, and may transmit the received X-ray image to thecontroller 310.

In detail, when it is determined based on the medical image that theobject has no abnormalities, the controller 310 may control the medicalimage except for a read assistance image associated with the medicalimage to be transmitted to the external apparatus 390. On the otherhand, when it is determined based on the medical image that the objecthas an abnormality, the controller 310 may control both the medicalimage and the read assistance image associated with the medical image tobe transmitted to the external apparatus 390.

The read assistance image may be generated according to a result of adetermination made by the medical imaging apparatus 300 as to whetherthe object has an abnormality. In detail, when the medical imagingapparatus 300 determines that the object has an abnormality, the medicalimaging apparatus 300 may generate a read assistance image, and, whenthe medical imaging apparatus 300 determines that the object has noabnormalities, the medical imaging apparatus 300 may generate no readassistance images.

Alternatively, the medical imaging apparatus 300 may obtain a readassistance image, regardless of a result of the determination as towhether the object has an abnormality. In detail, the read assistanceimage may be previously obtained before the medical imaging apparatus300 determines whether the object has an abnormality.

In detail, when it is determined based on the medical image that theobject has no abnormalities, the controller 310 may not generate a readassistance image associated with the medical image and may control themedical image to be transmitted to the external apparatus 390. When themedical image is obtained, the controller 310 may automatically performthe above-described determining operation and the above-describedtransmitting operation.

On the other hand, when it is determined based on the medical image thatthe object has an abnormality, the controller 310 may generate at leastone read assistance image associated with the medical image and maycontrol the medical image and the at least one read assistance image tobe transmitted to the external apparatus 390.

As another example, the controller 310 may obtain a medical image and atleast one read assistance image, and, when it is determined based on themedical image that the object has no abnormalities, the controller 310may control the medical image except for the at least one readassistance image to be transmitted to the external apparatus 390. Thecontroller 310 may obtain the medical image and the at least one readassistance image, and, when it is determined based on the medical imagethat the object has an abnormality, the controller 310 may control boththe medical image and the at least one read assistance image to betransmitted to the external apparatus 390.

The determination made based on the medical image by the controller 310as to whether the object has an abnormality may be performed viamechanical learning. In detail, mechanical learning may be performed viaa CAD operation of determining and detecting whether an object has anabnormality via a computer operation, via statistical learning based ondata, or via an artificial intelligence (AI) system that performsmechanical learning according to AI technology.

The AI system is a computer system that implements human-levelintelligence, and becomes increasingly smarter while autonomouslyperforming learning and determination, in contrast with existingrule-based smart systems. Because AI systems increase a recognition rateand more accurately understand user's preferences the more they areused, existing rule-based smart systems are being gradually replaced bydeep-learning AI systems.

AI technology includes mechanical learning (deep learning) and elementtechnologies employing the mechanical learning.

The mechanical learning is an algorithm technology thatclassifies/learns the features of pieces of input data by itself, andeach of the element technologies is a technology using a mechanicallearning algorithm, such as deep learning, and includes technicalfields, such as linguistic understanding, visual understanding,inferring/prediction, a knowledge expression, and operation control.

The controller 310 according to an embodiment may use learningtechnology included in AI technology for inferring and/or prediction,when determining whether the object has an abnormality. In detail,learning technology for inferring and/or prediction is a technology forlogically inferring results based on input information and outputtingresults corresponding to the input information, and includesknowledge/probability-based inferring, optimization prediction, apreference-based plan, recommendation, and the like. For example, AItechnology may analyze an object included in a received medical image,infer or predict whether the object has an abnormality, and output aresult of the inferring or prediction.

In detail, inferring and prediction according to AI technology may beperformed via an operation based on a neural network. In detail, anoperation based on a neural network, such as a DNN, may be used. The DNNoperation may include a convolution neural network (CNN) operation andthe like.

In detail, a data recognition model may be implemented via theabove-illustrated neural network, and may be learned using learningdata. Data input using a learned data recognition model, for example, amedical image, may be analyzed or classified, and thus what abnormalityhas occurred in an object image may be analyzed and classified from themedical image.

For example, the medical imaging apparatus 300 according to anembodiment may determine whether the object has an abnormality, vialearning and inferring operations based on a DNN. In detail, the medicalimaging apparatus 300 may determine whether the object has anabnormality, via learning and inferring operations based on a CNNoperation, which is a sort of a DNN operation.

At least one processor that performs learning and inferring operationsbased on a DNN may be referred to as a DNN processor. The DNN processormay be manufactured in the form of a dedicated hardware chip for AI, ormay be manufactured as a portion of an existing general-use processor(for example, a central processing unit (CPU) or an applicationprocessor) or a graphics dedicated processor (for example, a graphicsprocessing unit (GPU)) or a portion of the controller 310 and may bemounted on the above-described various electronic devices. When thecontroller 310 includes a DNN processor, the controller 310 may includeat least one processor that performs the aforementioned operations, andone of the at least one processor may be used as the DNN processor.

In detail, the controller 310 may determine whether the object has anabnormality, via learning and inferring operations based on a DNN. Indetail, the controller 310 may include a DNN processor, and the DNNprocessor may be implemented using a special chip, processor, or module.

The medical imaging apparatus 300 may include the DNN processor 330,separate from the controller 310.

The DNN processor 330 may determine whether the object has anabnormality, via learning and inferring operations based on a DNN. TheDNN processor 330 may transmit a result of the determination to thecontroller 310. In this case, the controller 310 may ascertain whetherthe object has an abnormality, based on a determination result obtainedby the DNN processor 330.

The above-described learning and inferring operations based on a DNNwill be described in more detail later with reference to FIG. 7.

The display 340 may display a UI screen, user information, imageprocessing information, and the like. In detail, the display 340 maydisplay a UI screen generated under the control of the controller 310.The UI screen may include at least one of a medical image and at leastone read assistance image. The UI screen may include information aboutwhether the object has an abnormality, which is obtained by analyzingthe medical image. For example, the display 340 may correspond to thedisplay 182 included in the X-ray apparatus 100 of FIG. 1. The UI screendisplayed on the display 340 will be described in more detail withreference to FIGS. 9 through 12B.

The memory 350 may include at least one program necessary for themedical imaging apparatus 300 to operate, or at least one instructionnecessary for the at least one program to be executed. The memory 350may also include one or more processors for performing theabove-described operations. The memory 350 may be a non-transitorystorage in some embodiments.

The memory 350 may store at least one of the medical image and the atleast one read assistance image, and may store information about whetherthe object has an abnormality.

The UI unit 360 may receive certain data or a certain command from auser. The UI unit 360 may correspond to at least one of the sub-userinterface 80 and the input device 181 of FIG. 1. The UI unit 360 may beimplemented using a touch screen integrally formed with the display 340.As another example, the UI unit 360 may include a user input device,such as a pointer, a mouse, or a keyboard.

According to an embodiment, the controller 310 may provide informationincluding a result of the first determination as to whether the objecthas an abnormality, to a user of at least one of the medical imagingapparatus 300 and the external apparatus 390.

According to an embodiment, the controller 310 may receive a signalcorresponding to a user input, and may perform the second determinationas to whether to transmit at least one read assistance image, based onthe received signal corresponding to the user input.

In detail, the controller 310 may control the display 340 to display aUI screen including a result of the first determination. The controller310 may also control the medical imaging apparatus 300 to output anaudio signal including the result of the first determination via aspeaker (not shown) included inside or outside the medical imagingapparatus 300.

The controller 310 may also control information including the result ofthe first determination to be transmitted to the external apparatus 390.Accordingly, the user of the external apparatus 390 may recognize theresult of the first determination.

Then, the user of at least one of the medical imaging apparatus 300 andthe external apparatus 390 may recognize the result of the firstdetermination and may determine whether to transmit the medical image tothe external apparatus 390 or whether to transmit both the medical imageand the at least one read assistance image to the external apparatus390. In detail, based on the result of the first determination, the usermay input, via the UI unit 360 of the medical imaging apparatus 300, auser input indicating whether to transmit the medical image to theexternal apparatus 390 or whether to transmit both the medical image andthe at least one read assistance image to the external apparatus 390.

Alternatively, based on the result of the first determination, the usermay input, to the external apparatus 390, the user input indicatingwhether to transmit the medical image to the external apparatus 390 orwhether to transmit both the medical image and the at least one readassistance image to the external apparatus 390. When the externalapparatus 390 receives the aforementioned user input, the externalapparatus 390 may transmit a signal corresponding to the user input tothe medical imaging apparatus 300. Accordingly, the medical imagingapparatus 300 may determine whether to transmit the at least one readassistance image to the external apparatus 390, based on the receivedsignal corresponding to the user input.

As described above, the controller 310 of the medical imaging apparatus300 may perform the second determination as to whether to transmit theat least one read assistance image, based on the user input or thesignal corresponding to the user input. In detail, when the user inputis an input requesting the at least one read assistance image to be nottransmitted to the external apparatus 390, the controller 310 maycontrol the medical image except for the at least one read assistanceimage to be transmitted to the external apparatus 390, according to theuser input. On the other hand, when the user input is an inputrequesting the at least one read assistance image to be transmitted tothe external apparatus 390, the controller 310 may control the at leastone read assistance image together with the medical image to betransmitted to the external apparatus 390, according to the user input.

FIG. 4 is a flowchart of a medical image transmitting method 400according to an embodiment. The medical image transmitting method 400according to an embodiment may be performed by the medical imagingapparatus 200 or 300. Accordingly, operations of the medical imagetransmitting method 400 may be performed by components of the medicalimaging apparatus 200 or 300, respectively, and the medical imagetransmitting method 400 may include the same structural features as themedical imaging apparatus 200 or 300. Accordingly, descriptions of themedical image transmitting method 400 that are the same as those madewith reference to FIGS. 1 through 3 are not repeated herein.

The medical image transmitting method 400 will now be described indetail with reference to the medical imaging apparatus 300 of FIG. 3.

Referring to FIG. 4, in the medical image transmitting method 400according to an embodiment, a medical image of an object is obtained, inoperation S410. Operation S410 may be performed under the control of thecontroller 310.

In the case that the medical image transmitting method 400 is performedby the medical imaging apparatus 300, the medical imaging apparatus 300may include an image capturing apparatus (not shown), and the controller310 may drive the image capturing apparatus to obtain a medical image.

For example, the controller 310 may drive the X-ray radiation device 110and the X-ray detector 195 to obtain an X-ray image, which is themedical image. Alternatively, the medical imaging apparatus 300 mayreceive a medical image from an external source. In this case, themedical imaging apparatus 300 may receive the medical image from anexternal medical imaging apparatus via the communicator 320.

In operation S420, it is determined whether the object has anabnormality, based on the medical image received in operation S410, andit is determined, based on the determination, whether to transmit atleast one read assistance image associated with the medical image. Whenthe medical image is received in operation S410, operation S420 may beautomatically performed by the controller 310. Alternatively, when theDNN processor 330 determines whether the object has an abnormality,operation S420 may be performed by the controller 310, based on adetermination result obtained by the DNN processor 330.

Also, in operation S420, the second determination as to whether totransmit the at least one read assistance image may be performed basedon a user input (or a signal corresponding to the user input). The userinput serving as a basis for determining whether to transmit the atleast one read assistance image has been described above with referenceto FIG. 3, and thus a detailed description thereof will be omitted.

When it is determined in operation S420 that the object has noabnormalities, the medical image may be transmitted to an externalapparatus, in operation S430. In detail, when it is determined inoperation S420 that the object has no abnormalities, the medical imageexcept for the read assistance image may be transmitted to an externalapparatus, in operation S430. Operation S430 may be performed by thecommunicator 320 under the control of the controller 310.

FIG. 5A is a flowchart of a medical image transmitting method 500according to another embodiment. Operations S510, S520 and S530 of themedical image transmitting method 500 of FIG. 5A may correspond tooperations S410, S420 and S430 of the medical image transmitting method400 of FIG. 4, respectively.

Referring to FIG. 5A, in the medical image transmitting method 500, amedical image of an object is obtained, in operation S510.

FIG. 6 illustrates a medical image obtained by an apparatus and a methodaccording to an embodiment.

The medical image received in operation S510 may be, for example, anX-ray image. Referring to FIG. 6, the medical image received inoperation S510 may be an X-ray image 600 obtained via X-ray scanning.The medical image received in operation S510 may be an original imageobtained via X-ray scanning. Alternatively, the X-ray image 600 may be apost-processed image obtained by post-processing the original image. Thepost-processing may include, for example, processing for reducing orremoving noise of the original image, and filter processing forclarifying an image. The medical image received in operation S510 is animage representing the object without changes, and may be an imagebefore processing for generating a read assistance image.

In operation S520, it is determined whether the object has anabnormality, based on the medical image received in operation S510, andit is determined, based on the determination, whether to transmit atleast one read assistance image associated with the medical image.

In detail, operation S520 may include operation S521 of determiningwhether the object has an abnormality and an operation of classifying aresult of the determination into a case S522 when the object is normaland a case S523 when the object is abnormal.

Operation S520 may be performed by the controller 310 or the DNNprocessor 330. As described above, operation S520 may be performed via aCAD operation or an AI system that performs mechanical learningaccording to AI technology. A case where the determining operation S520is performed via a DNN operation that is performed according to AItechnology will now be illustrated and described. The determiningoperation S520 via a DNN operation will be described in more detail withreference to FIG. 7. FIG. 7 is a view for explaining a DNN that is usedin an apparatus and a method according to an embodiment. A case where anoperation via a DNN 720 is performed by the DNN processor 330 will nowbe illustrated and described.

The DNN processor 330 may perform an operation via the DNN 720, the DNN720 including an input layer, a hidden layer, and an output layer. Thehidden layer may include a plurality of layers, for example, a firsthidden layer, a second hidden layer, and a third hidden layer.

Referring to FIG. 7, the DNN 720 includes an input layer 730, a hiddenlayer 740, and an output layer 750. FIG. 7 illustrates the DNN 720 thatperforms a DNN operation of analyzing information included in a medicalimage, which is input data, to determine whether an object image has anabnormality on the medical image, and outputting analysis informationabout a part of the object having an abnormality. In detail, when theinput data is an X-ray image 710, the DNN 720 outputs, as output data,result data obtained by analyzing an object image included in the X-rayimage 710. The X-ray image 710 corresponds to the medical image receivedin operation S510.

The plurality of layers that form the DNN 720 may include a plurality ofnodes 731 that receive data. As shown in FIG. 7, two adjacent layers areconnected to each other via a plurality of edges 736. Because the nodeshave weighted values, respectively, the DNN 720 may obtain output data,based on a value obtained by performing an arithmetic operation, forexample, multiplication, with respect to an input signal and each of theweighted values.

The DNN 720 may perform inferring and prediction operations based on aneural network, and the DNN operation may include a CNN operation andthe like. In other words, the DNN 720 may be implemented using a CNNthat performs a CNN operation.

Referring to FIG. 7, the input layer 730 receives the X-ray image 710obtained by scanning a chest, which is an object. The X-ray image 710may be an image obtained by scanning an object having a lesion 711 onhis or her right chest.

Referring to FIG. 7, the DNN 720 may include a first layer 761 formedbetween the input layer 730 and the first hidden layer, a second layer762 formed between the first hidden layer and the second hidden layer, athird layer 763 formed between the second hidden layer and the thirdhidden layer, and a fourth layer 764 formed between the third hiddenlayer and the output layer 750.

The plurality of nodes included in the input layer 730 of the DNN 720receive a plurality of pieces of data corresponding to the X-ray image710. The plurality of pieces of data may be a plurality of partialimages generated by performing filter processing of splitting the X-rayimage 710.

Via operations in the plurality of layers included in the hidden layer740, the output layer 750 may output pieces of output data/image 770 and780 corresponding to the X-ray image 710. In the shown illustration,because the DNN 720 performs an operation to obtain data indicatingwhether the object included in the input X-ray image 710 has anabnormality, the output layer 750 may output an image 770 displaying alesion 771 detected from the input X-ray image 710 and/or data 780obtained by analyzing the detected lesion 771. The data 780 isinformation indicating the characteristics of the detected lesion 771,and may include the type, seriousness, progress, size, and location ofthe lesion 771.

To increase the accuracy of output data output via the DNN 720, learningmay be performed in a direction from the output layer 750 to the inputlayer 730, and the weighted values may be corrected such that theaccuracy of output data increases. Accordingly, before the X-ray image710 is input, the DNN 720 may perform deep learning by using a pluralityof different chest X-ray images to correct the respective weightedvalues of the nodes in a direction for accurately detecting an abnormalpart included in a chest X-ray image, namely, in a direction thatincreases the accuracy of detecting the abnormal part.

The DNN 720 may automatically perform an operation of determiningwhether the object is normal or abnormal. The DNN 720 may automaticallyperform an operation of analyzing an abnormal object to generate animage or data indicating the characteristics of an abnormal part of theabnormal object.

In detail, in operation S520 of FIG. 5A, it may be only determinedwhether the object has an abnormality. In other words, in operation S520of FIG. 5A, only an operation of determining whether the object has anabnormality and thus is in an abnormal state or has no abnormalities andis thus in a normal state may be performed via the DNN 720. Anadditional analysis operation for obtaining the data 780 of FIG. 7 maynot be performed in operation S520.

In other words, to perform operation S520, the DNN 720 performs anoperation of determining whether the object is normal or abnormal. Whenit is determined that the object is in an abnormal state, the DNN 720may perform a learning operation corresponding to operation S540.

Referring back to FIG. 5A, when it is determined in operation S521 thatthe object is normal (case S522), only the medical image except for theread assistance image is transmitted to an external apparatus, inoperation S530. That is, operation S530 involves skipping the imagegeneration operation S542, and the operation S541.

On the other hand, when it is determined in operation S521 that theobject is abnormal (case S523), operation S540 may be further performed.Operation S540 may be performed by the controller 310 or the DNNprocessor 330. In detail, operation S541 may be performed via the DNN720.

In detail, when it is determined that the object is abnormal (caseS523), at least one read assistance image associated with the medicalimage may be generated, in operation S542.

The medical image transmitting method 500 may further include operationS541 to analyze the medical image when it is determined that the objectis abnormal (case S523). Based on a result of the analysis, at least oneread assistance image associated with the medical image may begenerated, in operation S542.

Operations S541 and S542 will now be described in detail with referenceto FIGS. 8A through 8D.

FIG. 8A is a view illustrating a medical image corresponding to when anobject has an abnormality. FIGS. 8B through 8D are views illustratingread assistance images generated when the object has an abnormality.

Referring to FIG. 8A, a case where a lesion is generated in a chest maybe illustrated as the case where the object has an abnormality, and anX-ray image 810 may be an original medical image.

FIGS. 8B, 8C, and 8D respectively illustrate a bone suppression image830 obtained based on the X-ray image 810, a lesion-detected CAD image850 obtained based on the X-ray image 810, and an abnormality map 870obtained based on the X-ray image 810. All of the images illustrated inFIGS. 8B, 8C, and 8D may be images obtained by processing the X-rayimage 810. In detail, the images illustrated in FIGS. 8B, 8C, and 8D maybe obtained by inputting the X-ray image 810 to the input layer 730 ofthe DNN 720 and performing a learning operation on the input X-ray image810 and output by the output layer 750.

Referring to FIG. 8A, when a lesion 811 is detected from the X-ray image810, which is a medical image, it may be determined that the object hasan abnormality.

When the object has an abnormality, the medical imaging apparatus 300may generate at least one read assistance image, for example, the bonesuppression image 830, the lesion-detected CAD image 850, and theabnormality map 870, by using the X-ray image 810, which is the medicalimage.

Referring to FIG. 8B, the bone suppression image 830 is an image onwhich an organ existing in the chest is more clearly shown by removingbones existing in the chest, including breast bones. The bonesuppression image 830 may be obtained via the above-described operationbased on the DNN 720. The bone suppression image 830 may be obtained viathe CAD operation. Breast bones that hide the lesion 811 have beenremoved from the bone suppression image 830. Accordingly, a doctor maymore accurately observe the lesion 811 by using the bone suppressionimage 830.

Referring to FIG. 8C, the lesion-detected CAD image 850 is an image onwhich a lesion existing in the object is detected via a CAD operationand displayed. The lesion-detected CAD image 850 puts a mark 851 on anobject part having the lesion 811 such that the doctor may ascertainexistence of the lesion 811 at a glance.

Referring to FIG. 8D, the abnormality map 870 is an image on which anabnormal part of a tissue or detailed areas included in the object isdetected and classified as at least one stage and displayed. Theabnormality map 870 displays a part 871 having a lesion differently froma normal object part such that the doctor may easily check an abnormalpart of the object and the degree of the abnormality.

Referring back to FIG. 5A, in the medical image transmitting method 500,the at least one read assistance image generated in operation S542 istransmitted to the external apparatus 390, together with the medicalimage, in operation S543. Operation S543 may be performed by thecommunicator 320 under the control of the controller 310.

In the medical image transmitting method 500, at least one of theobtained medical image and the obtained at least one read assistanceimage may be displayed or stored, in operation S550.

In detail, when the object is normal, no read assistance images aregenerated, and thus the memory 350 may store only the medical image.When the object is normal, the display 340 may display only the medicalimage, except for the read assistance image.

On the other hand, when the object is abnormal, a medical image and atleast one read assistance image are generated, and thus the memory 350may store the medical image and the at least one read assistance image.When the object is abnormal, the display 340 may display the medicalimage and the at least one read assistance image.

FIG. 5B is a flowchart of a medical image transmitting method 555according to another embodiment. Operations of FIG. 5B that are the sameas operations described above with reference to FIG. 5A are indicated bythe same reference numerals, and thus a repeated description of themedical image transmitting method 500 given above with reference to FIG.5A is omitted in the description of the medical image transmittingmethod 555 of FIG. 5B.

Referring to FIG. 5B, in the medical image transmitting method 555, amedical image and at least one read assistance image associated with themedical image may be obtained, in operation S560. In detail, in themedical image transmitting method 555, the at least one read assistanceimage associated with the medical image may be obtained regardless ofwhether the object has an abnormality. In detail, in the medical imagetransmitting method 555, the medical image and the at least one readassistance image associated with the medical image may be obtainedbefore determining whether the object has an abnormality. Operation S560may be performed under the control of the controller 310.

In operation S520, it is determined whether the object has anabnormality, based on the medical image received in operation S560, andit is determined, based on the determination, whether to transmit the atleast one read assistance image associated with the medical image.

When it is determined in operation S521 that the object is normal (caseS522), the medical image except for the read assistance image istransmitted to an external apparatus, in operation S530. On the otherhand, when it is determined that the object is abnormal (case S523),both the medical image and the at least one read assistance image aretransmitted to the external apparatus, in operation S543.

In the medical image transmitting method 555, at least one of theobtained medical image and the obtained at least one read assistanceimage may be displayed or stored, in operation S550.

FIG. 5C is a flowchart of a medical image transmitting method 570according to another embodiment.

Referring to FIG. 5C, in the medical image transmitting method 570, amedical image of an object may be obtained, in operation S510.

In the medical image transmitting method 570, at least one readassistance image associated with the medical image obtained in operationS510 may be generated based on the obtained medical image, regardless ofwhether the object has an abnormality, in operation S580. In detail, inthe medical image transmitting method 570, the at least one readassistance image associated with the medical image may be obtainedbefore determining whether the object has an abnormality. Operation S580may be performed under the control of the controller 310. Operation S580corresponds to operation S542 of FIG. 5A, and thus a detaileddescription thereof will be omitted.

Thereafter, in operation S520, it is determined whether the object hasan abnormality, based on the medical image received in operation S510,and it is determined, based on the determination, whether to transmitthe at least one read assistance image associated with the medicalimage.

When it is determined in operation S521 that the object is normal (caseS522), the medical image except for the read assistance image istransmitted to an external apparatus, in operation S530. On the otherhand, when it is determined that the object is abnormal (case S523),both the medical image and the at least one read assistance image aretransmitted to the external apparatus, in operation S543.

In operation S550, at least one of the obtained medical image and theobtained at least one read assistance image may be displayed or stored,in operation S550.

As described above, in the medical image transmitting methods 400 and500, according to embodiments, and the medical imaging apparatuses 200and 300 performing the same, when it is determined based on the medicalimage that the object is normal, the read assistance image associatedwith the medical image is not transmitted to an external apparatus,thereby preventing unnecessary transmission and generation of data. Inother words, when the object has no abnormalities, unnecessarygeneration and/or transmission of the read assistance image may beprevented. Accordingly, a workflow of medical image reading may beoptimized, and a doctor or the like does not need to unnecessarily reada read assistance image, thereby increasing reading efficiency.

In the medical image transmitting method 500 according to an embodimentand the medical imaging apparatus 300 performing the same, when theobject has an abnormality, a plurality of read assistance imagesassociated with a medical image may be generated, and may be arranged ina certain order, based on the characteristics of an abnormal part of theobject. The medical image, and the plurality of read assistance imagesarranged in the certain order may be transmitted to the externalapparatus 390. This operation may be performed under the control of thecontroller 310. In the medical image transmitting method 500, thearrangement operation may be performed after operation S542.

In detail, the medical imaging apparatus 300 may detect abnormalitycharacteristics by analyzing the medical image. The abnormalitycharacteristics are characteristic information representing an abnormalpart, and thus may include the type of a disease, a location thereof,the probability that the abnormal part is a disease, a progress of thedisease, a progress stage thereof, and/or the reliability of thecharacteristic information. The read assistance images may be arrangedsuch that an image clearly showing these abnormality characteristics maybe arranged in an order of priority.

For example, when the medical imaging apparatus 300 analyzes the medicalimage and detects lung pneumothorax, the abnormality characteristics mayinclude the size of the lung pneumothorax and information of a locationof the lung pneumothorax within the object.

The medical imaging apparatus 300 may arrange the plurality of readassistance images, in an order of images more clearly showing anabnormal part of the object, in detail, a detected disease, based on theabnormality characteristics.

In detail, referring to FIGS. 8A through 8D, when the lesion 811 isdetected from the object as a result of analyzing the medical image 810,the plurality of read assistance images may be arranged such that a readassistance image clearly showing the lesion 811 is prioritized. Forexample, the bone suppression image 830, the lesion-detected CAD image850, and the abnormality map 870 may be generated as the read assistanceimages associated with the medical image 810. Because the lesion 811 isthe most clearly shown on the bone suppression image 830, which is abone-removed image, the bone suppression image 830 may be arranged at atop priority, the lesion-detected CAD image 850 on which the lesion 811is the next most clearly shown may be arranged next to the bonesuppression image 830, and the abnormality map 870 may be arranged last.

As another example, when the possibility of a disease is included as theabnormality characteristic information, the plurality of the readassistance images may be arranged such that an image clearly showing anobject part highly likely to be a disease may be prioritized. Forexample, when a plurality of portions or body parts of the object haveabnormalities as a result of analyzing the medical image, a readassistance image clearly showing a part the most highly likely to be adisease may be arranged at a top priority, and a read assistance imageclearly showing a part the second most highly likely to be a disease maybe arranged at a next top priority.

When the object has a certain lesion, the medical imaging apparatus 300may select the type of a read assistance image to be generated, based onabnormality characteristics, which are characteristics of the lesion.This selection may be performed by the controller 310. Theabove-described operation of detecting abnormality characteristics maybe performed via the above-described operation based on a neuralnetwork.

In detail, when the object has a certain lesion, the controller 310 maydetermine the type of a read assistance image to be generated, based onthe characteristics of the lesion, and may generate at least one readassistance image according to the determined type. For example, thecontroller 310 may select the type of a read assistance image capable ofclearly showing a lesion, and may control a read assistance image of theselected type to be generated.

FIG. 9 is a view illustrating a UI screen generated in an apparatus anda method according to an embodiment.

The medical imaging apparatus 300 according to an embodiment maygenerate a medical image including information indicating that an objectis normal or abnormal, such that a medical image corresponding to whenthe object has an abnormality and is accordingly abnormal may bedistinguished from a medical image corresponding to when the object hasno abnormalities and is accordingly normal, according to whether theobject has an abnormality.

In detail, when the object has no abnormalities, the medical imagingapparatus 300 may attach a normality mark indicating that the object isnormal to the medical image. In detail, the controller 310 may control amedical image having the normality mark attached thereto to begenerated. The normality mark is information indicating that no abnormalparts have been detected from the object, and may be expressed using atleast one of a character, a symbol, and a color. Although expressed as a‘mark’, this mark means all signs that distinguish normality fromabnormality. For example, a case where the object is normal and a casewhere the object is abnormal may be distinguished from each other bydifferentiating the contour color of a medical image.

Referring to FIG. 9, when no abnormal parts have been detected from anobject as a result of analyzing a medical image 910 of the object andthus the medical imaging apparatus 300 determines that the object isnormal, the medical imaging apparatus 300 may generate a medical image910 having a normality mark ‘N’ 920 attached thereto. The illustratednormality mark ‘N’ 920 is a mark indicating ‘Normal’.

When the object is normal, the medical imaging apparatus 300 maytransmit the medical image 910 having the normality mark ‘N’ 920attached thereto to the external apparatus 390.

When the object has no abnormalities, the medical imaging apparatus 300may generate data corresponding to a first UI screen 900 including themedical image 910 except for a read assistance image. The communicator320 of the medical imaging apparatus 300 may transmit data correspondingto the first UI screen 900 to the external apparatus 390 under thecontrol of the controller 310. Then, a display (not shown) of theexternal apparatus 390 may display the first UI screen 900.

The medical imaging apparatus 300 may display the medical image 910 orthe first UI screen 900 on the display 340.

As described above, when it is determined via analysis of the medicalimage 910 that the object is normal, the medical imaging apparatus 300according to an embodiment may generate no read assistance images, andmay neither transmit any read assistance image to the external apparatus390 nor display any read assistance image on the display 340.

In other words, a user, such as a doctor, may easily and quicklyascertain that the object is normal, by checking the normality mark ‘N’920 via the first UI screen 900 displayed on a display. When it isdetermined that the object is normal, the user, such as a doctor, doesnot spend time to read a read assistance image, thereby increasing thereading efficiency and diagnosis efficiency.

FIG. 10 is another view illustrating a UI screen generated in anapparatus and a method according to an embodiment.

Referring to FIG. 10, when the object has an abnormality, the medicalimaging apparatus 300 according to an embodiment may attach anabnormality mark ‘Ab’ 1020 indicating that the object is abnormal, to amedical image 1010. In detail, the controller 310 may control a medicalimage having an abnormality mark attached thereto to be generated. Theabnormality mark is information indicating that at least one abnormalpart has been detected from the object. Similar to the normality mark,the abnormality mark may be expressed using at least one of a character,a symbol, and a color.

FIG. 10 illustrates a case where a lesion 1011 is detected from theobject and accordingly it is determined that the object is abnormal.

Referring to FIG. 10, when the medical imaging apparatus 300 determinesthat the object is abnormal because an abnormal part has been detectedfrom the object as a result of analyzing the medical image 910, which isan image of the object, the medical imaging apparatus 300 may generate amedical image 1010 having the abnormality mark ‘Ab’ 1020 attachedthereto. The illustrated abnormality mark ‘Ab’ 1020 is a mark indicating‘Abnormal’.

When the object is abnormal, the medical imaging apparatus 300 maytransmit the medical image 1010 having the abnormality mark ‘Ab’ 1020attached thereto, together with one or more read assistance images 1030,1040, and 1050, to the external apparatus 390.

When the object has an abnormality and thus it is determined that theobject is abnormal, the medical imaging apparatus 300 may generate datacorresponding to a second UI screen 1000 including the medical image1010 and the read assistance images 1030, 1040, and 1050. Thecommunicator 320 of the medical imaging apparatus 300 may transmit datacorresponding to the second UI screen 1000 to the external apparatus 390under the control of the controller 310. Then, the display (not shown)of the external apparatus 390 may display the second UI screen 1000.

The medical imaging apparatus 300 may display the medical image 1010 orthe second UI screen 1000 on the display 340.

FIG. 11 is another view illustrating a UI screen generated in anapparatus and a method according to an embodiment.

Referring to FIG. 11, a UI screen 1100 includes the medical image 1010and the plurality of read assistance images 1030, 1040, and 1050included in the second UI screen 1000 of FIG. 10.

The medical imaging apparatus 300 according to an embodiment may displaythe UI screen 1100 on the display 340. The medical imaging apparatus 300according to an embodiment may receive a manipulation, input, or requestof a user via the UI unit 360.

In detail, in response to a selection input of selecting one of theplurality of read assistance images 1030, 1040, and 1050 displayed onthe UI screen 1100, the controller 310 may control the selected readassistance image to be displayed on a main screen area on which themedical image 1010 is displayed.

The medical imaging apparatus 300 may receive an input of setting aregion of interest (ROI) on the medical image 1010 displayed on the UIscreen 1100. Then, the medical imaging apparatus 300 may magnify anddisplay the ROI set on the medical image 1010. For example, the user mayset a part of the object having the lesion as an ROI and thus mayprecisely observe the part having the lesion.

The medical imaging apparatus 300 may receive the selection input ofselecting one of the plurality of read assistance images 1030, 1040, and1050 displayed on the UI screen 1100, and then may receive the input ofsetting an ROI on the medical image 1010.

For example, the UI unit 360 may include a mouse that is used to selector set a certain part on the UI screen 1100. The user may input orselect certain data by manipulating the mouse. In the above example, theuser may select the read assistance image 1050, which is an abnormalitymap, from the plurality of read assistance images 1030, 1040, and 1050displayed on the UI screen 1100, by using the mouse, and then maysubsequently set an ROI 1110 on the medical image 1010.

Then, the medical imaging apparatus 300 may overlap an image 1120obtained by magnifying a portion corresponding to the ROI 1110 in theabnormality map 1050, which is the selected read assistance image, onthe medical image 1010 and may display a result of the overlapping.

Accordingly, the user may magnify and view a portion having a lesionfrom a read assistance image, thereby facilitating a diagnosis of thelesion.

FIGS. 12A and 12B are other views illustrating UI screens generated inan apparatus and a method according to an embodiment.

Referring to FIG. 12A, when it is determined via analysis of a medicalimage that an object has an abnormality, the medical imaging apparatus300 according to an embodiment may classify the abnormality of anabnormal part of the object into a plurality of stages 1210. Forexample, the medical imaging apparatus 300 may classify a normal case asa normal (N) stage 1211, which is a single stage, and may classify anabnormal case as one stage from among five stages, which are Ab1(Abnormal 1) through Ab5 (Abnormal 5) stages 1212, 1213, through to1214.

In other words, an abnormality mark displayed may be classified into asingle stage from among a plurality of stages, according to the analysisof the abnormality of an abnormal part of the object, and theabnormality classification may be displayed.

In detail, the plurality of stages may be set or defined based on thesize of the abnormal part, the progress of a disease, which is presentin the abnormal part, and the seriousness of the disease, which ispresent in the abnormal part.

Alternatively, the medical imaging apparatus 300 may match the pluralityof stages with a plurality of color levels or a plurality of graylevels, and may reflect a matched color in a medical image. For example,in a color bar 1220 including the plurality of gray levels or theplurality of color levels, a brightest color may be matched to an Nstage 1211, which is a normal stage, and a darkest color may be matchedto an Ab5 stage 1214, which is a stage having a highest abnormality. Inanother example, each stage could be set to have a specific color, suchas red, orange, green, blue, etc., so that a user can quickly determinethe stage by merely viewing the specific color that is displayed.

The medical imaging apparatus 300 may display an abnormality of anabnormal part detected from a current medical image, by using a marker1221 on the color bar 1220. In other words, when an abnormality stagecorresponds to a certain color, the medical imaging apparatus 300 maydisplay the marker 1221 on a portion of the color bar 1220 where thecertain color is located.

The plurality of stages indicating the degree of normality orabnormality may be expressed using at least one of a character, asymbol, and a color, or a combination thereof.

Referring to FIG. 12B, a UI screen 1250 corresponds to a case where theobject has an abnormality. The UI screen 1250 includes a medical image1260 and a plurality of read assistance images 1280. The medical imagingapparatus 300 may display a marker 1270 indicating the stage of theabnormality of an abnormal part of the object, on the medical image1260. Accordingly, the user may quickly ascertain a progress stage of adisease of the object or the seriousness thereof from the medical image1260.

FIG. 13 is a block diagram illustrating an implementation of a medicalimaging apparatus according to an embodiment.

The medical imaging apparatus 300 according to an embodiment may bemounted on a workstation (for example, the workstation 180 of the X-rayapparatus 100) or a console of an apparatus that captures a medicalimage, for example, the X-ray apparatus 100 of FIG. 1, a CT apparatus,an MRI system, or an ultrasound diagnosis apparatus. A medical imagingapparatus 1320 of FIG. 13 may correspond to the above-describedworkstation (for example, the workstation 180 of the X-ray apparatus100) or the above-described console.

The medical image transmitting method 500 according to an embodiment maybe performed by the medical imaging apparatus 1320 of FIG. 13.

Referring to FIG. 13, the medical imaging apparatus 1320 may receivedata including a captured image or raw data 1310 obtained by performingmedical image capturing in operation S1305, and may obtain a medicalimage, based on the received data, in operation S1325. In operationS1331, the medical imaging apparatus 1320 may determine based on themedical image whether the object has an abnormality. When it isdetermined that the object has an abnormality and is thus classified asan abnormal state, the medical imaging apparatus 1320 may automaticallygenerate abnormality read assistance data including informationindicating abnormality characteristics and/or at least one readassistance image, in operation S1333. In operation S1335, the medicalimaging apparatus 1320 may automatically transmit the generated data tothe external apparatus 390, for example, a PACS server 1350.

FIG. 14 is a block diagram illustrating another implementation of amedical imaging apparatus according to an embodiment. Components of FIG.14 that are the same as the components of FIG. 13 are indicated by thesame reference numerals or characters. Thus, a repeated descriptionthereof is omitted in the description of the components illustrated inFIG. 14.

The medical imaging apparatus 300 according to an embodiment may bemounted on a special apparatus or server independent from an apparatusthat captures a medical image, for example, the X-ray apparatus 100 ofFIG. 1, a CT apparatus, an MRI system, or an ultrasound diagnosisapparatus. For example, a medical imaging apparatus 1420 of FIG. 14 maybe mounted on a workstation for analysis, an external medical apparatus,a PACS viewer, an external medical server, or a hospital server.

The medical image transmitting method 500 according to an embodiment maybe performed by the medical imaging apparatus 1420 of FIG. 14.

In detail, when a workstation 1410 corresponds to the workstation 180 ofthe X-ray apparatus 100 of FIG. 1, the workstation 1410 may transmit amedical image obtained via medical image capturing to the medicalimaging apparatus 1420, which is another medical server within ahospital. Then, the medical imaging apparatus 1420 may automaticallydetermine, based on the received medical image, whether an object isnormal, and may perform an additional reading operation.

Referring to FIG. 14, the workstation 1410 of the apparatus thatcaptures a medical image may receive data including a captured image orraw data obtained by performing medical image capturing in operationS1305, and may obtain a medical image, based on the received data. Theworkstation 1410 transmits the obtained medical image to the medicalimaging apparatus 1420. Then, the medical imaging apparatus 1420 mayperform operation S1430. In detail, in operation S1331, the medicalimaging apparatus 1420 may determine based on the medical image whetherthe object has an abnormality. When it is determined the object has anabnormality and is thus classified as an abnormal state, the medicalimaging apparatus 1420 may automatically generate abnormality readassistance data including information indicating abnormalitycharacteristics and/or at least one read assistance image, in operationS1333. In operation S1335, the medical imaging apparatus 1420 mayautomatically transmit the generated data to the external apparatus 390,for example, a PACS server 1450.

When the workstation 1410 corresponds to the workstation 180 of theX-ray apparatus 100 of FIG. 1, the workstation 1410 may immediatelytransmit a medical image obtained via medical image scanning to theexternal apparatus 390, for example, the PACS server 1450. The medicalimaging apparatus 1420 may receive the medical image from the externalapparatus 390, for example, the PACS server 1450, may perform operationsS1331 and S1333, based on the received medical image, and may transmitabnormality reading assistance data generated as a result of operationsS1331 and S1333 to the external apparatus 390, for example, the PACSserver 1450. That is, the workstation 1410 could directly connect to thePACS server 1450, and the PACS server 1450 could directly communicatewith the medical imaging apparatus 1420.

Accordingly, the external apparatus 390, for example, the PACS server1450, may obtain the medical image and the abnormality readingassistance data and provide the obtained medical image and the obtainedabnormality reading assistance data to a user, such as a doctor.

FIG. 15 is a block diagram illustrating another implementation of amedical imaging apparatus according to an embodiment. Components of FIG.15 that are the same as the components of FIGS. 13 and 14 are indicatedby the same reference numerals or characters. Thus, a repeateddescription thereof is omitted in the description of the componentsillustrated in FIG. 15.

The medical imaging apparatus 300 according to an embodiment may bemounted on a special apparatus or server independent from an apparatusthat captures a medical image, for example, the X-ray apparatus 100 ofFIG. 1, a CT apparatus, an MRI system, or an ultrasound diagnosisapparatus. For example, a medical imaging apparatus 1520 of FIG. 15 maybe mounted on a workstation for analysis, an external medical apparatus,a PACS server, an external medical server, or a hospital server.

The medical image transmitting method 500 according to an embodiment maybe performed by the medical imaging apparatus 1520 of FIG. 15. Theembodiment of FIG. 15 is different from that of FIG. 14 in that themedical imaging apparatus 1520 is an independent electronic apparatuscapable of independently processing, storing, and managing medical imagedata, such as a PACS server, and thus autonomously may store and manageat least one read assistance image without transmitting the at least oneread assistance image to another external apparatus.

Referring to FIG. 15, the workstation 1410 of the apparatus thatcaptures a medical image may receive data including a captured image orraw data obtained by performing medical image capturing in operationS1305, and may obtain a medical image, based on the received data. Theworkstation 1410 transmits the obtained medical image to the medicalimaging apparatus 1520, for example, a PACS server. Then, the medicalimaging apparatus 1520 may perform operation S1430. In detail, inoperation S1331, the medical imaging apparatus 1520 may determine basedon the medical image whether the object has an abnormality. When it isdetermined the object has an abnormality and is thus classified as anabnormal state, the medical imaging apparatus 1520 may automaticallygenerate abnormality read assistance data including informationindicating abnormality characteristics and/or at least one readassistance image, in operation S1333. In operation S1545, the medicalimaging apparatus 1520 may automatically store the generated abnormalityread assistance data. The medical imaging apparatus 1520 may transmit atleast one of the abnormality read assistance data obtained via operationS1430 and the medical image to a PACS viewer or a workstation 1530connected to the PACS viewer. Then, the PACS viewer or the workstation1530 connected to the PACS viewer may provide the received abnormalityread assistance data and the received medical image to a user, such as adoctor.

FIG. 15 illustrates a case where operation S1430 of FIG. 15 is performedby the medical imaging apparatus 1520. However, operation S1430 of FIG.15 may also be performed by the PACS viewer or the workstation 1530connected to the PACS viewer, wherein the PACS viewer and theworkstation 1530 are connected to the medical imaging apparatus 1520.

In a medical image transmitting method according to an embodiment, and amedical imaging apparatus performing the same, when it is determinedbased on the medical image that the object is normal, the readassistance image associated with the medical image is not transmitted toan external apparatus, thereby preventing unnecessary transmission andgeneration of data. Accordingly, when the object has no abnormalities,unnecessary generation and/or transmission of the read assistance imagemay be prevented. Accordingly, a workflow of medical image reading maybe optimized, and a doctor or the like does not need to unnecessarilyread a read assistance image, thereby increasing reading efficiency.

Embodiments may be implemented through non-transitory computer-readablerecording media having recorded thereon computer-executable instructionsand data. The instructions may be stored in the form of program codes,and when executed by a processor, generate a predetermined programmodule to perform a specific operation. Furthermore, when being executedby the processor, the instructions may perform specific operationsaccording to the embodiments.

While one or more embodiments have been described with reference to thefigures, it will be understood by one of ordinary skill in the art thatvarious changes in form and details may be made therein withoutdeparting from the spirit and scope of the present disclosure as definedby the following claims.

Accordingly, the above embodiments and all aspects thereof are examplesonly and are not limiting.

What is claimed is:
 1. A medical image transmitting method comprising:obtaining a medical image generated by imaging an object; performing afirst determination to determine whether the object has an abnormality,based on the medical image; performing a second determination todetermine, based on the first determination, whether to transmit atleast one assistance image associated with the medical image; and whenthe object has no abnormalities, transmitting, to an external apparatus,the medical image.
 2. The medical image transmitting method of claim 1,wherein the transmitting, to the external apparatus, of the medicalimage comprises, when the object has no abnormalities, not generatingthe at least one assistance image associated with the medical image. 3.The medical image transmitting method of claim 1, wherein the obtainingof the medical image comprises obtaining the medical image and the atleast one assistance image.
 4. The medical image transmitting method ofclaim 1, further comprising: when the object has an abnormality,generating at least two assistance images associated with the medicalimage; and arranging the at least two assistance images in a certainorder, based on characteristics of the abnormality of the object, andtransmitting the medical image and the at least two assistance imagesarranged in the certain order to the external apparatus.
 5. The medicalimage transmitting method of claim 1, wherein the transmitting, to theexternal apparatus, of the medical image comprises, when the object hasno abnormalities, attaching, to the medical image, a normality markindicating that the object is normal, and transmitting, to the externalapparatus, the medical image to which the normality mark has beenattached.
 6. The medical image transmitting method of claim 5, whereinthe transmitting, to the external apparatus, of the medical imagefurther comprises, when the object has an abnormality, attaching, to themedical image, an abnormality mark indicating that the object isabnormal, and transmitting, to the external apparatus, the medical imageto which the abnormality mark has been attached.
 7. The medical imagetransmitting method of claim 6, wherein the abnormality mark isclassified into one of a plurality of stages according to a degree ofabnormality of the abnormality, and the plurality of stages aredisplayed on a display.
 8. The medical image transmitting method ofclaim 1, further comprising: when the object has a lesion, determining atype of an assistance image to be generated, based on characteristics ofthe lesion, and generating the at least one assistance image accordingto the determined type; and transmitting the medical image and the atleast one assistance image to the external apparatus.
 9. The medicalimage transmitting method of claim 1, further comprising: when theobject has no abnormalities, generating data corresponding to a firstuser interface (UI) screen comprising the medical image; and when theobject has an abnormality, generating data corresponding to a second UIscreen comprising the medical image and the at least one assistanceimage.
 10. The medical image transmitting method of claim 9, furthercomprising: when the object has no abnormalities, transmitting the datacorresponding to the first UI screen to the external apparatus; and whenthe object has an abnormality, transmitting the data corresponding tothe second UI screen to the external apparatus.
 11. The medical imagetransmitting method of claim 1, wherein the performing the firstdetermination comprises determining whether the object has anabnormality, via learning operations based on a deep neural network(DNN).
 12. The medical image transmitting method of claim 1, wherein themedical image comprises an X-ray image, and the external apparatuscomprises at least one of a picture archiving communications system(PACS) server, a PACS viewer, and a workstation for controlling amedical imaging apparatus that performs medical image capturing.
 13. Themedical image transmitting method of claim 1, wherein the performing thefirst determination comprises analyzing the medical image and detectinga presence of a lesion in the medical image, and wherein the at leastone assistance image comprises an image of the lesion and a markingindicating the presence of the lesion.
 14. The medical imagetransmitting method of claim 1, wherein the performing a seconddetermination to determine comprises: receiving a signal correspondingto an user input requesting to transmit the at least one assistanceimage or not; and performing the second determination based the signalcorresponding to the user input.
 15. A medical imaging apparatuscomprising: a controller configured to: obtain a medical image generatedby imaging an object, perform a first determination to determine whetherthe object has an abnormality, perform a second determination todetermine, based on the first determination, whether to transmit atleast one assistance image associated with the medical image, and, whenthe object has no abnormalities, transmit, to an external apparatus, themedical image; and a communicator configured to transmit the medicalimage to the external apparatus.
 16. The medical imaging apparatus ofclaim 15, wherein, when the object has no abnormalities, the controlleris further configured to attach, to the medical image, a normality markindicating that the object is normal, and transmit, to the externalapparatus, the medical image to which the normality mark has beenattached.
 17. The medical imaging apparatus of claim 15, wherein, whenthe object has an abnormality, the controller is further configured toattach, to the medical image, an abnormality mark indicating that theobject is abnormal, and transmit, to the external apparatus, the medicalimage to which the abnormality mark has been attached.
 18. The medicalimaging apparatus of claim 15, wherein, when the object has anabnormality, the controller is further configured to generate at leasttwo assistance images associated with the medical image, arrange the atleast two assistance images in a certain order, based on characteristicsof an abnormal part of the object, and control the medical image and theat least two assistance images arranged in the certain order to betransmitted to the external apparatus.
 19. The medical imaging apparatusof claim 15, wherein, when the object has a lesion, the controller isfurther configured to determine a type of an assistance image that is tobe generated, based on a type of the lesion, generate the at least oneassistance image according to the determined type, and transmit themedical image and the at least one assistance image to the externalapparatus.
 20. The medical imaging apparatus of claim 15, wherein whenthe object has no abnormalities, the controller is further configured tocontrol generation of data corresponding to a first UI screen comprisingthe medical image; and when the object has an abnormality, thecontroller is further configured to control generation of datacorresponding to a second UI screen comprising the medical image and theat least one assistance image; and the controller is further configuredto control transmitting of the data corresponding to the first UI screenor the data corresponding to the second UI screen to the externalapparatus.
 21. The medical imaging apparatus of claim 15, wherein whenthe object has no abnormalities, the controller is further configured tocontrol generation of data corresponding to a first UI screen comprisingthe medical image; and when the object has an abnormality, thecontroller is further configured to control generation of datacorresponding to a second UI screen comprising the medical image and theat least one assistance image; and the medical imaging apparatus furthercomprises a display configured to display the first UI screen or thesecond UI screen under the control of the controller.
 22. The medicalimaging apparatus of claim 15, further comprising a deep neural network(DNN) processor configured to perform learning operations via a DNN,wherein the controller is further configured to perform the firstdetermination to determine whether the object has an abnormality, viathe learning operations based on the DNN.
 23. The medical imagingapparatus of claim 15, further comprising an X-ray radiator configuredto radiate X-rays to the object, wherein the controller is furtherconfigured to control the X-ray radiator to obtain the medical image.24. The medical imaging apparatus of claim 15, wherein the firstdetermination comprises analyzing the medical image and detecting apresence of a lesion in the medical image, and wherein the at least oneassistance image comprises an image of the lesion and a markingindicating the presence of the lesion.
 25. A medical imaging apparatuscomprising: a communicator; and a controller configured to: obtain amedical image generated by imaging an object, analyze the medical imageto determine whether an abnormality is present or the abnormality is notpresent in the medical image, if the abnormality is present in themedical image, generate at least one assistance image based on themedical image in an assistance image generation operation, and controlthe communicator to transmit both the medical image and the at least oneassistance image to an external apparatus, and if the abnormality is notpresent in the medical image, not generate the at least one assistanceimage by skipping the assistance image generation operation and controlthe communicator to transmit only the medical image, to the externalapparatus, wherein the at least one assistance image comprises a markingindicating a presence of the abnormality.
 26. The medical imagingapparatus of claim 25, wherein when the object has no abnormalities, thecontroller is further configured to control generation of datacorresponding to a first UI screen comprising the medical image; andwhen the object has an abnormality, the controller is further configuredto control generation of data corresponding to a second UI screencomprising the medical image and the at least one assistance image; andthe controller is further configured to control the communicator totransmit the data corresponding to the first UI screen or the datacorresponding to the second UI screen to the external apparatus.
 27. Themedical imaging apparatus of claim 25, wherein: when the object has noabnormalities, the controller is further configured to controlgeneration of data corresponding to a first UI screen comprising themedical image; and when the object has an abnormality, the controller isfurther configured to control generation of data corresponding to asecond UI screen comprising the medical image and the at least oneassistance image; and the medical imaging apparatus further comprises adisplay, and the controller is configured to control the display todisplay the first UI screen or the second UI screen.
 28. A medicalimaging apparatus comprising: a display; and a controller configured to:obtain a medical image generated by imaging an object, analyze themedical image to determine whether an abnormality is present in themedical image, if an abnormality is present in the medical image,generate at least one assistance image and control the display todisplay both the medical image and the at least one assistance image,and if an abnormality is not present in the medical image, control thedisplay to display only the medical image, and not the at least oneassistance image.